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Abstract 

The RKKY interaction between rare-earth (RE) ions in high-T c supercon- 
ductors is considered at T < T c . It is shown that this interaction consists 
of two terms: conventional oscillating one and the positive term, which is 
proportional to the gap function and decreases in the 2D case inversely pro- 
portional to the distance. In the antiferromagnetic state of the RE subsystem 
this positive interaction gives rise for frustrations which diminishes the Neel 
temperature. In the case of strongly anisotropic gap function this frustration 
produces two different values of the effective nearest neighbor exchange cou- 
pling between RE ions along the a and b. This anisotropy has been established 
experimentally in Ref. 
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In many High-T c superconductors substitution of some ions by rare-earth elements (RE) 
leads to the low-temperature antiferromagnetism in the RE subsystem with Tjy of order of 
1 K and without sizeable change of the superconducting transition temperature T c . The 
mostly investigated compounds are Yf^CusOy-a; (1:2:3) and YB^Cu/iOs (1:2:4) with 
yttrium being substituted by different RE ions (see and references therein). 

The magnetic dipolar, superexchange and RKKY interactions has been attracted for 
explanation of this antiferromagnetism in the RE subsystem. The detailed calculations, 
however, have been carried out only for dipolar interaction. Corresponding results have 
been presented in [||] and || for (1:2:3) and (1:2:4) compounds, respectively. In 
particular, it was pointed out in ||] that there is no correlation between the ground state 
energies calculated in the dipolar approximation and observed Neel temperatures. Hence the 
dipolar interaction alone cannot explain the magnetic properties of the considered systems. 
Moreover, a striking feature of the magnetic interaction between the RE ions is the very large 
difference between effective nearest neighbor exchange interactions along crystallographic a 
and b directions. Indeed, the specific heat data near T/v for 1:2:3 system with Sm and Nd 
ions was very well fitted |||7| using 2D Ising model with strongly different exchange constants 
J i and J 2- The ratio J\j J<i was found to be ~ 11 and 50 for Sm and Nd samples respectively 
f|. Recent measurements for NdBa2Cu30y_5 @ confirmed this result and revealed that the 
ratio J\j ' J<i depends on doping and increases rapidly with 5. As it was emphasized in Ref. 
such a behaviour indicates that chains cannot be the direct reason of this anisotropy, 
since the structural anisotropy decreases with depleting of the chains. 

More direct confirmation of this anisotropy has been provided || by the inelastic neutron 
scattering in HoBasCugC^. The values of J a = (0.0005 ± 0.0002)meV and J b = -(0.0028 ± 
0.0008)meV were reported there. 

The orthorombic distortion in the considered compounds is very small [(a — b) /a ~ 
10 -2 — 10~ 3 ] and weakly depends on 5. Therefore, it cannot explain the anisotropy of 
superexchange and dipolar interactions. At the same time it is well known that the hole 
system responsible for the superconductivity possesses pronounced anisotropy in the a-b 
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plane which strongly depends on the oxygen content 5. This anisotropy was established for 
the Fermi surface PJTOfl and is apparently presented in the superconducting gap function 



Ak pQ| , [TT|] . Moreover, the anisotropy of Ak should persist in any system with anisotropic 
Fermi surface. As a result we may suggest that the above exchange anisotropy of the RE 
subsystem stems from the interaction between the RE ions and holes in CuC>2 planes. 

To date we have no direct information about interaction between the RE ions and Cu02 
planes in metal state. Meanwhile for antiferromagnetic compound HoBa2Cus06.i3 this inter- 
action has been evaluated on the base of experimentally observed splitting of the Holmium 

doublet. This splitting appears due to the interaction of Ho ion with spinwaves in CuC>2 



planes JT^|. It was found that exchange integral between Ho total angular momentum and 
Cu 2+ spin is equal to 2.4 meV. Therefore we see that this interaction is not so weak and the 
same should be valid for the metal state, as well. 

The RE-hole interaction gives rise to the RKKY interaction between the RE ions, which 
should be anisotropic due to the anisotropics of the Fermi surface and of the gap function, 
mentioned above. In this paper we consider the problem of anisotropy of the RKKY inter- 
action in superconducting state which stems from the anisotropy of the gap function. The 
effects arising from the non-circular shape of Fermi surface will be considered elsewhere. 

We obtain the following principal result. At T C T c the 2D RKKY interaction is a 
sum of two terms. The first one is the conventional oscillating contribution and the second 
term is positive and decreases as R~ x . It is proportional to \/S.- R \/E F where A R is the gap 
function along R direction. Both terms are screened at distances of order of Vj?/|ArJ. The 
second term should strongly frustrate the AF ground state due to its long-range behavior. 
If the gap Ar has not square symmetry this frustration is different in the a and b directions. 
As a result the effective exchange parameters J a and should be different, too. 

This paper is organized as follows. In Sec. II we evaluate the 2D RKKY interaction for 
IvfR 1 in the case of anisotropic gap function and in Sec. Ill we discuss the physical 
consequences of these results. 
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I. RKKY INTERACTION BETWEEN RE IONS IN SUPERCONDUCTORS 

WITH ANISOTROPIC PAIRING 



We begin with the conventional form of the exchange interaction between RE total 
angular moment J and the hole spin density l/2cr(r) in Cu02 planes [13 

V(r) = -J ex (9J - l)J(r)<7(r) , (1) 

where J ex is the exchange interaction and gj is the ionic ^-factor. As a result we may write 
the RKKY interaction between two RE ions in the following form 

Hrkky = 2[J ex (g,j - 1)] 2 J!J 2 /(R 12 ) , (2) 

where below T c we have 

J(R)=T^{G(^ n ,R) 2 + |F(^ n ,R)| 2 } . (3) 

n 

Here u n = irT(2n + 1) is the Matsubara frequency and the normal and anomalous Green 
functions are given by 

GK^l^/a^m ^lL ( 4) 

F(iu n , R) = — J d 2 kexp(zkR)-j T ^__ (5 ) 

where a 2 is the volume of the square unit cell of the 2D lattice, £k is the hole spectrum 
above T c and is the superconducting gap function. The conventional form of writing of 
the RKKY interaction below T c |14| may be obtained from eqs. (2)-(5) after summation 



over u n . 

We are interested in the dependence of I(R) on the direction of R in the ab plane. The 
case of a non-circular shape of the Fermi surface appears to be a quite complex problem and 
will be analyzed elsewhere. Remarkable fact presented below is the possibility to obtain the 
expression for the RKKY interaction at large distances for the circular Fermi surface and 



arbitrary form of the gap function A k . Hence we take the following parametrization of the 
normal-state dispersion £ k and the function A k : 

k 2 



kp 



2m 



(6) 



where f is the polar angle in the ab plane. 

We begin with evaluation of asymptotic expressions for G and F functions at k F R 1 
and then determine the corresponding form of the RKKY interaction. Taking into account 
that Ep > Aj,,Twe may put k = kp + ^/Vp where Vp = kpjm. Then, integrating in Eq.(4) 
over £, we get 

iip uj + ^/u 2 + A 2 + ^ sign(cosip) 

V^ 2 + A U* 



G(R,u) 



a 2 m 



2ni 
x exp 



d V e lkFRcos 

R 

Vf 



(7) 



uj 2 + A 2 ,^ cosy?) 



where ip defines the direction of R. The expression for F(R, a;) is obtained, if one replaces 



(u ± y^ 2 + A 2 ^) by tA^ in (7). 

If kpR ^> 1, the steepest decent method may be used. Expanding cosy? near the points 
(p = 0, 7r and taking into account that A 2 = A 2 +7r we have 



G(R, u) 



a 2 m 



{27ik F R) 1 / 2 



^ 2 + A 2 R 



cos (^kpR — — ^ 



7T 



sin kpR 
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cxp 



T^ 2 + A - 



Vi 



1/2' 



F(R,u) = 



a 2 m 



A 



R 



(2Kk F R)W ^2 + A ^ 



cos ( k F R — 



7T 



cxp 



R_ 

Vp 



(8) 
(9) 



where A R stands for the absolute value jA^] at (p — ip. We drop the phase of A^ in the 
numerator of (9), since it is irrelevant for the interaction (3). 

Expressions (8) and (9) take place if one can neglect the variation of A^ + ^ in the range 
\<p + VI ^ {2/kpR) 1 / 2 at R < V F (A^ + uo 2 )- 1 ' 2 . These conditions may be combined in the 
following form 

(ArA r ) 2 A' 2 



E F {uj 2 + Alf/ 2 E R A R 
5 



< 1 



(10) 



Here in the right-hand side we put oo ~ T < Ar. For most directions we have A' R ~ Ar 
and the condition (10) fulfills very well since always A R <C E F . However it is violated if the 
gap function has a node at ip — ip n . Indeed, in this case we have Ar = A n \ip — ip n \ near 
the node and instead of (10) we get A n /[E F \i> — (p n \] <C 1. Therefore near the directions of 
nodes the Eqs. (8) and (9) persist if 



\lp-(p n \ > \A n \/E F . 



(11) 



For example, in the case of the d x 2_ y 2 pairing we may write approximately A^ ~ A cos2<^. 
In this case we have (f n = ±7r/4; ±37r/4 and A n = ±2A . 

From the condition (11) we see that Eqs. (8) and (9) hold almost in all directions of R 
excluding narrow vicinities the gap nodes. We begin with the regions where condition (11) 
fulfills. Using Eqs. (3), (8) and (9) we get 



J(R) = 



4 

am 



2nk F R 
r 2R, 

x exp 



LOt. 



K + Ar 



sin2k F R 



RJ 



-^(^ 2 + A R ) 1 / 2 



(12) 



We are interested in very low temperatures of order of 1 K or less. In this case we may put 
T = and instead of (12) we have 

,2 



J(R) 



4 2 

am 



duo 



CO 



2ix 2 k F R Jo \u 2 + A R 

( 

exp 



sin2k F R 



Ar 



^(c 2 + A R )V 2 
Vf 



(13) 



cu 2 + A R/ 

In the normal state when Ar = we obtain from this equation the asymptotic form of the 
two-dimensional RKKY interaction 



/o(R) = 



4 

am 



4tt 2 R 2 

For A R 7^ after some algebra we get 



sin2/ci?i? . 



(14) 



Ar 



sin 2kpR {2RA R 
-F 1 



+ 



(k F R) 2 ~ l \ V F 
/2RA R ^ 



E F {k F R) V V F 



(15) 



where 



F 1 {x)= ( ^—{y 2 - x 2 f' 2 = 1; x«l 



/ \ 1/2 

(s) e"*;x»l 



Fa(ic)=/ d T(y 2 -V 2 = f; X<<1 (16) 

1/2 



There are two important features of these equations. First, the superconducting gap 
gives rise to the screening of the RKKY interaction. The range of the screening depends 
strongly on the R direction and is given by 

U = , (17) 

where £ m = Vf/ A m and A m = max(Apt). Note here that the value of £ m , apparently related 
to T c , is usually adopted as the superconducting correlation length. We see that it is the 
lowest value of the screening length for the case of anisotropic pairing. 

Second, in addition to the usual oscillating term, the long-range positive interaction 
appears. This interaction is proportional to \A-r\/Ef and depends strongly on direction of 
R. In spite of its weakness, this part of the interaction should be important due to its very 
slow decreasing with R, if R < £ R . In the vicinity of the AF transition it should produce 
strong frustration and diminish the Neel temperature. 

We considered above the directions of R determined by the condition (11). In the 
opposite limiting case when \ip — ip n \ \A n \/Ep, the screening range (17) seemingly goes 
to infinity. We will show now that it is not the case. 

If we put ip = ip n in Eq.(7), we have A^^ = A n ip. As a result the A 2 ^ contribution to 
the exponential factor in (7) becomes important at R > (E F / A n ) 2 /k F - Thus the range of 
screening along the nodes is given by 

C n = (E F /A n ) 2 /k F ~ U{E F /A n ) > U . (18) 
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At the same time similarly to Eq.(7) the expression for F(R, uj) is zero due to the oddness 
of the integrand as a function of (p in this case. 

Summarizing we can say that Eq.(15) is a good approximation for /(R) at kpR ^> 1 if 
near the nodal directions one replaces the argument of function iq by -EV- 
IL DISCUSSION 

We have demonstrated that below T c RKKY interaction given by Eq.(15) is a sum of two 
terms. First is conventional one which in the 2D case oscillates as sm2kpR and decreases 
as (kpR)~ 2 - Second term is strongly anisotropic positive (of the antiferromagnetic sign) 
contribution proportional to the small parameter An/Ep and decreasing as (fep-R) -1 . Both 
terms are screened at distances determined by Eqs. (17) and (18). However these equations 
hold in the pure case only. In real systems interaction with impurities may lead to a lower 
value of the screening range, especially in the directions of nodes. 

In spite of a small factor A-^/Ep the second term in Eq.(15) is important due to its very 
slow decreasing with R. In presence of long-range antiferromagnetic order in the Rare-Earth 
subsystem it produces frustration and reduces the Neel temperature. 

Let us return now to the mentioned in Introduction anisotropy of the exchange parame- 
ters in the a-b plane. In |6|-f| the specific-heat and neutron scattering data were described 
using 2D anisotropic exchange in a-b plane. Of course, it is only a convenient parametriza- 
tion and the real interaction is much more complex. However an anisotropy in the a-b plane 
is one of its most important features. The above mentioned positive part of the RKKY 
interaction may be one of sources of such anisotropy, if the gap function has not square 



symmetry, e.g. if it is a mixture of d x 2_ y 2 and extended s-wave function as discussed in |T0 
In this case Ab ^ A a and corresponding frustration becomes different in these two direc- 
tions. Effectively this situation may be modelled by nearest-neighbour exchange parameters 
J a 7^ Jb as it was actually done in Refs. 

It should be noted, however, that the observed asymmetry of the Fermi surface in a-b 
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plane is another possible source of anisotropy of the RKKY interaction. 
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